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BY EXPRESS MAIL NO. EL254066439US 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re Application of 

TARO SUITO ET AL. 

Application No. Unknown 

Filed: November 23, 1999 

For: INFORMATION 

PROCESSING APPARATUS, 
INFORMATION 
PROCESSING METHOD, 
AND DISTRIBUTION MEDIA 



Group Art Unit: Unknown 

Examiner: Unknown 

PRELIMINARY AMENDMENT 

2001 Ferry Bldg. 

San Francisco, CA 94111 

Ph.: 415-433-4150 



Assistant Commissioner for Patents 
Washington, D.C. 20231 



Sir: 

Please preliminarily amend the above identified application as follows: 



In the Specification 

Page 10, line 12, please change "FIGS. 17A to 17D" to 
-FIGS. 17A and 17E-; 

Page 10, line 14, please change "FIGS. 18A to 18D" to 
-FIGS. 18A and 18E-; 
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REMARKS 



The above change conforms the specification to the drawings and/or 
correct typographical errors. 

It is submitted that all of the claims are in condition for allowance and 
the Examiner's early examination and consideration are respectfully 
requested. 
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LIMBACH & LIMBACH L.L.P. 
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INFORMATION PROCESSING APPARATUS, 
INFORMATION PROCESSING METHOD, AND 
DISTRIBUTION MEDIA 

CROSS-REFERENCES TO RELATED APPLICATIONS 
This application is related to U.S. Patent Application Numbers 

and , both of which are filed on the same date 

as this application. These applications correspond with Attorney 
Docket Nos. SONY-Q9137 and SONY-Q9139. Both applications are 
titled INFORMATION PROCESSING APPARATUS, INFORMATION 
PROCESSING METHOD, AND DISTRIBUTION MEDIA, both have the 
same inventors as this application and both are assigned to the 
assignee of the present invention. Both of said applications are 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
The present invention relates to an information processing 
apparatus, an information processing method and a provision 
medium, and more particularly to those adapted for detecting a 
commercial advertisement (herein referred to as a "commercial" or a 
"CM") included in a television broadcast. 

When reproducing a recorded television broadcast, some users 
want to watch only the program itself without any commercials. In 
order to satisfy this desire, there are known video recorders equipped 
with a commercial cut function to skip commercials by fast 
forwarding. 

A typical commercial detection algorithm employed in such a 
video recorder is based on the following characteristics common to 
most commercials. That is, a quiet section of 0.1 to 2.0 seconds is 
at the start and end of each commercial; image scene change points 
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are in the quiet section; the required time of each commercial is an 
integral multiple of 15 seconds; and (e.g., for commercials broadcast 
outside of the United States) the audio multiplex mode changes from 
a monaural mode for programs to a stereo mode for commercials. In 
television broadcasts in Europe and America, black or blue frames are 
typically inserted between a program and a commercial. Upon 
confirmation of such characteristics, the relevant portion is detected 
as a commercial. 

Therefore, according to the known commercial detection 
algorithms, it is impossible to detect any commercial that holds none 
of the above characteristics, e.g., a Japanese commercial where the 
audio multiplex mode is monophonic. 

Another problem according to the known commercial 
detection algorithm is that, in case the above characteristics are 
included in the program, the relevant portion thereof is detected as a 
commercial. 

Further, if any characteristic of the commercials employed in 
the known algorithm were changed or abolished (for example, if the 
required commercial time were changed to an integral multiple of 14 
seconds or if the insertion of black or blue frames were abolished in 
Europe and America), there would arise a problem that commercials 
would be rendered undetectable. 

In a quiet section detection method adopting the known 
commercial detection algorithm, a quiet section is detected by first 
calculating the average audio level in a certain section and, if the 
calculated average level is below a predetermined threshold value, 
regarding the relevant section as a quiet one. Consequently, the 
precision of such quiet section detection becomes different when the 
television reception is not satisfactory, i.e., if the radio field intensity 
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is low and the S/N of the audio signal is inferior, or if the radio field 
intensity is not low. Under such circumstances, accurate detection 
of commercials may be impossible. 

Moreover, according to the known commercial detection 
algorithms, the required commercial time is clocked by counting the 
number of frames on the basis of approximately 30 frames per 
second. However, since an error of several frames is often caused in 
an actual broadcast, a margin of error is provided in the threshold 
value for decision of the required time. Consequently, erroneous 
detection or non-detection of the commercial may be caused by this 
margin of error. 

In addition to the above, there arises a further problem that, 
when a television station advertisement spot of 5 seconds or so is 
broadcast between a commercial and a program, such spot fails to 
be detected as it has no characteristic of commercials, although it 
may be perceived as a commercial by television viewers. 

SUMMARY OF THE INVENTION 
It is an object of the invention to provide a method, apparatus 
and computer program for correctly detecting commercials contained 
in television broadcasts. 

It is a further object of the present invention to reduce or 
eliminate the need to view commercials when reproducing previously 
recorded television broadcasts. 

It is a feature of the present invention to stop recording of a 
television broadcast when a commercial is detected. 

It is an additional feature of the present invention to instead 
index commercials when recording a television broadcast in order to 
permit the high speed fast forwarding through such commercials, yet 
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preserve the ability to view such commercials according to the 
wishes of a viewer. 

!t is an advantage of the present invention to reduce the 
amount of time a viewer must spend in viewing a desired television 
program. 

It is a further advantage of the present invention to reduce the 
amount of recording media storage space necessary to record a 
desired television program, by not recording commercials 
interspersed with the desired television program. 

It is yet another advantage of the present invention to allow a 
viewer to index commercials to permit the viewing of such 
commercials when desired by the viewer. 

According to one aspect of the invention, there is provided an 
apparatus for processing a television signal which includes: means 
for receiving a television signal; means for detecting a commercial 
candidate block which consists of one or more commercial candidate 
sections in the television signal; means for measuring a length of the 
commercial candidate block; means for making a first judgement of 
whether the length of the commercial candidate block is within a 
predetermined range of an integral multiple of a standard length; and 
means for determining whether the commercial candidate block is a 
commercial block according to the first judgement. 

According to another aspect of the invention, there is provided 
an apparatus for processing a television signal which includes: means 
for receiving a television signal; means for detecting a commercial 
candidate section in the television signal; means for measuring a 
length of the commercial candidate section; means for making a first 
judgement of whether the length of the commercial candidate 
section is within a first predetermined range of an integral multiple of 
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a standard length; means for measuring the length of an intermediate 
section between commercial candidate sections; means for making a 
second judgement of whether the length of the intermediate section 
is within a second predetermined range; and means for determining a 
commercial block of one or more commercial candidate sections 
according to the first judgement and the second judgement. 

According to another aspect of the invention, there is provided 
an apparatus for processing a television signal which includes: means 
for receiving a television signal; means for extracting a commercial 
based on a reference criterion indicative of a commercial 
characteristic; means for detecting an alteration of the commercial 
characteristic; and means for changing the reference criterion 
according to the alteration of the commercial characteristic detected 
by the alteration detecting means. 

According to another aspect of the invention, there is provided 
an apparatus for processing a television signal which includes: a 
receiver for receiving a television signal; a first detector for detecting 
a commercial candidate block which consists of one or more 
commercial candidate sections in the television signal; a measuring 
circuit for measuring a length of the commercial candidate block; a 
comparitor for making a comparison of whether the length of the 
commercial candidate block is within a predetermined range of an 
integral multiple of a standard length; and a second detector for 
determining whether the commercial candidate block is a commercial 
block according to the comparison. 

According to another aspect of the invention, there is provided 
an apparatus for processing a television signal which includes: a 
receiver for receiving a television signal; a detector for detecting a 
commercial candidate section in the television signal; a timer for 
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measuring a length of the commercial candidate section and for 
measuring the length of an intermediate section between commercial 
candidate sections; a first comparitor for making a first comparison 
of whether the length of the commercial candidate section is within 
a first predetermined range of an integral multiple of a standard 
length; a second comparitor for making a second comparison of 
whether the length of the intermediate section is within a second 
predetermined range; and a commercial block detector for detecting 
a commercial block of one or more commercial candidate sections 
according to the first comparison and the second comparison. 

According to another aspect of the invention, there is provided 
an apparatus for processing a television signal which includes: 
a receiver for receiving a television signal; a commercial extracting 
circuit for extracting a commercial based on a reference criterion 
indicative of a commercial characteristic; a detector for detecting an 
alteration of the commercial characteristic; and an updating circuit 
for updating the reference criterion according to the alteration of the 
commercial characteristic detected by the detector. 

According to another aspect of the invention, there is provided 
a method of processing information in an information processing 
apparatus for detecting commercials included in a television 
broadcast, wherein the method includes: receiving a television signal; 
detecting a commercial candidate block which consists of one or 
more commercial candidate sections in the television signal; 
measuring a length of the commercial candidate block; making a 
judgement of whether the length of the commercial candidate block 
is within a predetermined range of an integral multiple of a standard 
length; and determining whether the commercial candidate block is a 
commercial block according to the judgement. 
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According to another aspect of the invention, there is provided 
a method for processing a television signal which includes: a signal 
receiving step of receiving a television signal; a commercial candidate 
section detecting step of detecting a commercial candidate section in 
the television signal; a first measuring step of measuring a length of 
the commercial candidate section; a first judgement step of making a 
first judgement of whether the length of the commercial candidate 
section is within a first predetermined range of an integral multiple of 
a standard length; a second measuring step of measuring the length 
of an intermediate section between commercial candidate sections; a 
second judgement step of making a second judgement of whether 
the length of the intermediate section is within a second 
predetermined range; and a commercial block determining step of 
determining a commercial block of one or more commercial candidate 
sections according to the first judgement and the second judgement. 

According to another aspect of the invention, there is provided 
a provision medium for providing a program which is readable by a 
computer to control an apparatus to execute a detection routine for 
detecting commercials included in a television broadcast, the 
detection routine including the steps of: receiving a television signal; 
detecting a commercial candidate block which consists of one or 
more commercial candidate sections in the television signal; 
measuring a length of the commercial candidate block; making a 
judgement of whether the length of the commercial candidate block 
is within a predetermined range of an integral multiple of a standard 
length; and determining whether the commercial candidate block is a 
commercial block according to the judgement. 
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According to another aspect of the invention, a provision 
medium provides a program which is readable by a computer to 
control an apparatus to execute a detection routine for detecting 
commercials included in a television broadcast, wherein the detection 
routine includes the following steps: receiving a television signal; 
detecting a commercial candidate section in the television signal; 
measuring a length of the commercial candidate section; making a 
first judgement of whether the length of the commercial candidate 
section is within a first predetermined range of an integral multiple of 
a standard length; measuring the length of an intermediate section 
between commercial candidate sections; making a second judgement 
of whether the length of the intermediate section is within a second 
predetermined range; and determining a commercial block of one or 
more commercial candidate sections according to the first judgement 
and the second judgement. 

According to another aspect of the invention, a provision 
medium provides a program which is readable by a computer to 
control an apparatus to execute a detection routine for detecting 
commercials included in a television broadcast, wherein the detection 
routine includes the following steps: receiving a television signal; 
extracting a commercial based on a reference criterion indicative of a 
commercial characteristic; detecting an alteration of the commercial 
characteristic; and changing the reference criterion according to the 
alteration of the commercial characteristic detected in the alteration 
detecting step. 

These and other objects, features and advantages will become 
apparent when considered with reference to the following description 
and the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing a first structural example of 
a video recorder where the present invention is applied; 

FIG. 2 is a block diagram showing a first structural example of 
a commercial detection circuit of FIG. 1; 

FIG. 3 is a flowchart for explaining the operation of a 
commercial detection circuit; 

FIG. 4 is a flowchart for explaining the routine executed by a 
quiet threshold determiner of FIG. 2; 

FIGS. 5A to 5C are diagrams for explaining the operation of a 
quiet threshold determiner of FIG. 2; 

FIG. 6 is a graphic diagram for explaining the 
operation of a quiet threshold determiner of FIG. 2; 

FIG. 7 is a diagram for explaining the operation of a quiet 
threshold determiner of FIG. 2; 

FIG. 8 is a flowchart for explaining a routine of quiet section 
detection executed at step S2 of FIG. 3; 

FIG. 9 is a flowchart for explaining a routine of scene change 
detection executed at step S3 of FIG. 3; 

FIG. 10 is a diagram for explaining a routine of scene change 
detection; 

FIG. 1 1 is a diagram for explaining information which may be 
recorded in an internal memory of a first embodiment of the 
commercial candidate section detector; 

FIGS. 12A to 12C are diagrams for explaining a routine 
executed by a first embodiment of the commercial candidate section 
detector; 
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FIG. 13 is a diagram for explaining the information which may 
be recorded in an internal memory of a second embodiment of the 
commercial candidate section detector; 

FIGS. 14A to 14G are diagrams for explaining a routine 
executed by a second embodiment of the commercial candidate 
section detector; 

FIGS. 1 5A to 15C are diagrams for explaining a routine 
executed by a first embodiment of the commercial candidate section 
detector; 

FIG. 16 is a block diagram showing a second structural 
example of the commercial detection circuit of FIG. 1; 

FIGS. 17A to 17D are diagrams for explaining a 
routine executed by the commercial block detector of FIG. 1 6; 

FIGS. 18A to 18D are diagrams for explaining a routine 
executed by the commercial detection circuit of FIG. 1 ; 

FIG. 19 is a block diagram showing a third structural example 
of the commercial detection circuit of FIG. 1; 

FIG. 20 is a flowchart for explaining the operation of a 
commercial characteristic quantity detector of FIG. 19; 

FIG. 21 is a flowchart for explaining a routine of audio signal 
periodicity detection executed at step S43 of FIG. 20; 

FIGS. 22A and 22B are diagrams for explaining a routine of 
audio signal periodicity detection; 

FIG. 23 is a flowchart for explaining a routine of continuity 
detection executed at step S44 of FIG. 20; 

FIG. 24 is a flowchart for explaining a routine of repetition 
detection executed at step S45 of FIG. 20; 

FIG. 25 is a flowchart for explaining a routine of telop 
detection executed at step S46 of FIG. 20; 
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FIGS. 26A to 26C are diagrams for explaining a routine of 
teiop detection; 

FIG. 27 is a flowchart for explaining a routine of quietness rate 
detection executed at step S48 of FIG. 20; 

FIG. 28 is a diagram for explaining a routine of quietness rate 
detection; and 

FIG. 29 is a block diagram showing a second structural 
example of a video recorder where the present invention is applied. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Referring now to FIG. 1, a description will be given of a first 
structural example of a video recorder where the present invention is 
applied. Tuner 2 in a recording unit demodulates the RF signal of a 
television broadcast inputted from a terminal 1 to thereby obtain a 
video signal, an audio signal, an AGC signal and a signal indicative of 
an audio multiplex mode (hereinafter referred to simply as an audio 
multiplex mode signal), and then supplies these signals to 
commercial detection circuit 3. Further, tuner 2 also supplies the 
video signal and the audio signal to delay circuit 4. 

Commercial detection circuit 3 makes a decision as to whether 
the signals from tuner 2 represent a commercial or not, and then 
outputs control signal 0 or 1 to switch 6 in accordance with the 
result of such decision. Switch 6 is turned on in response to a 
control signal 1 or is turned off in response to a control signal 0. 

Delay circuit 4 delays the input video and audio signals from 
tuner 2 by a time period required for execution of the processing 
routine in commercial detection circuit 3 {e.g., one minute in this 
embodiment), and then supplies the delayed signals to a modulation 
circuit 5. Subsequently, modulation circuit 5 compresses and 
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encodes the input video and audio signals from delay circuit 4 into a 
predetermined format {e.g., MPEG2 format) and, after modulating 
the signals by a predetermined modulation method [e.g., EFM), 
supplies the modulated signals to a write circuit 7 via switch 6. 
Then, write circuit 7 records the input modulated signals on 
magnetic tape 8. 

In response to a command from a user, read circuit 9 in a 
reproducing unit reads and demodulates the signals recorded on 
magnetic tape 8, and then supplies the demodulated signals to a 
monitor (not shown). 

The medium used for recording such video and audio signals is 
not limited to a magnetic tape alone. For example, the medium may 
be an optical disk, a magneto-optical disk, a hard disk, or a 
semiconductor memory. 

FIG. 2 shows a first embodiment of commercial detection 
circuit 3 of FIG. 1 . In this commercial detection circuit 3, the audio 
multiplex mode signal inputted from tuner 2 is supplied to both quiet 
threshold determiner 1 1 and commercial candidate section detector 
16; the video signal is supplied to a delay path 14 and a scene 
change detector 15; the audio signal is supplied to an A/D converter 
1 2; and the AGC signal is supplied to quiet threshold determiner 1 1 . 

Quiet threshold determiner 1 1 calculates a threshold value, 
which is to be used for detection of a quiet section, on the basis of 
the audio multiplex mode signal, the audio signal digitized by A/D 
converter 12, the AGC signal or the signal inputted from scene 
change detector 1 5, or any combination of these, and then supplies 
the threshold value to quiet section detector 13. 

Quiet section detector 1 3 detects the quiet section by 
comparing the level of the digital audio signal obtained from A/D 
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converter 1 2 with the threshold value supplied from quiet threshold 
determiner 1 1 , and then outputs the result to scene change detector 
15. 

Scene change detector 1 5 compares two frame images 
inputted thereto simultaneously (i.e., the current frame and the 
preceding frame delayed by a time period of one frame [1/30 second] 
via delay path 14), thereby detecting the presence or absence of a 
scene change in the quiet section, and then outputs the result to 
commercial candidate section detector 16. 

In this embodiment, commercial candidate section detector 16 
encodes the audio multiplex mode signal and the scene change 
information supplied from scene change detector 15 into binary 
information per frame, then stores the same in an internal memory 
and, after detecting the commercial candidate section on the basis of 
such information, outputs control signal 1 to switch 6 in the 
commercial candidate section, or outputs a control signal 0 in any 
section other than the commercial candidate section. Note that in 
alternative embodiments, other information may be used to detect a 
commercial candidate. The information of the preceding minute is 
stored in the internal memory of commercial candidate section 
detector 1 6. In this case, the storage capacity of such internal 
memory is expressed as 



60 (seconds) X 30 (frames) X 2 (data) X 1 (bit). 



Next, the operation of commercial detection circuit 3 will be 
described with reference to a flowchart of FIG. 3. The processing 
routine of such commercial detection is started upon input of each 
signal from tuner 2 to commercial detection circuit 3. At step S1 , 
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quiet threshold determiner 1 1 in commercial detection circuit 3 
supplies to quiet section detector 13 the threshold value 13 
calculated in advance (as will be mentioned later) to be used for the 
routine of quiet section detection (step S2). 

The details of such quiet threshold determination will be 
described below with reference to a flowchart of FIG. 4. In the 
following description, quiet threshold value determining unit 1 1 
performs many different functions. In practice, these functions 
could be performed by one component or by two or more 
components. 

At step S1 1 , A/D converter 1 2 converts the audio signal 
(analog) of a predetermined short time, which has been inputted 
from tuner 2, into a digital signal at a predetermined sampling 
frequency and a predetermined quantization level, and then supplies 
the digital audio signal {e.g., FIG. 5A) thus obtained to quiet 
threshold determiner 11. At step S1 2, quiet threshold determiner 1 1 
converts the digital audio signal inputted from A/D converter 1 2 into 
absolute-value samples as shown in FIG. 5B, and then calculates, at 
step S13, the average value (FIG. 5C) of the absolute-value samples. 

Subsequently at step S14, quiet threshold determiner 1 1 
compares the average value obtained at step S13 with the threshold 
value stored until then, and stores the smaller value as a new 
threshold value. 

At step S1 5, quiet threshold determiner 1 1 makes a decision 
as to whether the processes at steps Sll to S14 have been 
completely executed or not with regard to all channels. If the result 
of this decision is negative, signifying that the processes have not 
yet been executed with regard to all channels, the operation 
proceeds to step S16. Quiet threshold determiner 1 1 outputs, at 
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step S16, a channel switching signal to tuner 2, and the channel is 
switched in response to the channel switching signal. 

If the result of the decision at step S1 5 is affirmative, 
signifying that the processes at steps S1 1 to S14 have been 
completely executed with regard to all channels, the routine of quiet 
threshold determination is terminated. This routine of quiet threshold 
determination is executed repeatedly at a predetermined interval of, 
e.g., 1 0 minutes. 

The routine of quiet threshold determination may be executed 
by some other method than the above. For example, the audio 
signal may be received at a broadcast start time and a broadcast end 
time of each channel when the audio signal level becomes zero with 
certainty while the video signal is existent, and a quiet threshold 
value may be set to n + A which is obtained by adding a 
predetermined offset value A to the audio signal level n. It is 
supposed here that the broadcast start time and end time of each 
channel are known in advance. Also, the quiet threshold value may 
be determined by the use of the AGC signal obtained from tuner 2. 
More specifically, as shown in FIG. 6, the level of the AGC signal 
inputted from tuner 2 has a predictable relationship to the amplitude 
of the audio signal. Therefore, by inferring the amplitude of the 
audio signal from the level of the AGC signal, it is rendered possible 
to uniquely determine the threshold value corresponding to the 
inferred amplitude. 

Further, since the buzz component of the audio signal is 
dependent on the brightness level of the video signal, the quiet 
threshold value may be determined by using the average value of the 
video signal luminance level. If the average value of the luminance 
level is high, for example, the buzz component of the audio signal 
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increases to eventually raise the audio signal level for a fixed period 
of time. In this case, therefore, the threshold value is set to be 
higher than the normal value. If the average value of the luminance 
level is low, the buzz component of the audio signal decreases to 
eventually lower the audio signal level for a fixed period of time. In 
this case, therefore, the threshold value is set to be lower than the 
normal value. The average value Y A of the video signal luminance is 
calculated as follows in scene change detector 1 5: 

Y A = (ED,,) / n X m 
where i = 1 to n, j = 1 to m, and D„ denotes the pixel value at 
coordinates (i, j) of the image corresponding to the audio signal, as 
shown in FIG. 7. 

In addition to the above methods, the quiet threshold value 
may be determined on the basis of the audio multiplex mode signal 
as well. That is, the quiet threshold value may be set to the audio 
signal level obtained at the point of switching the audio multiplex 
mode from a monaural, bilingual broadcast to a stereo broadcast. 

Referring back to FIG. 3 again, quiet section detector 13 
detects, at step S2, the quiet section on the basis of the threshold 
value inputted from quiet threshold determiner 1 1 at step S1 . The 
processing routine of this quiet section detection will now be 
described in detail with reference to a flowchart of FIG. 8. 

At step S21, A/D converter 12 converts the audio signal 
(analog) of a predetermined short time, which has been inputted 
from tuner 2, into a digital signal at a predetermined sampling 
frequency and a predetermined quantization level, and then supplies 
the digital audio signal {e.g., FIG. 5A) thus obtained to quiet 
threshold determiner 11. At step S22, quiet threshold determiner 1 1 
converts the digital audio signal inputted from A/D converter 1 2 into 
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absolute-value samples as shown in FIG. 5B, and then calculates, at 
step S23, the average value (FIG. 5C) of the absolute-value samples. 

At step S24, quiet threshold determiner 1 1 makes a decision 
as to whether the average value obtained at step S23 is smaller than 
the threshold value inputted from quiet threshold determiner 1 1 , and 
if the result of this decision signifies that the average value is smaller 
than the threshold value, the operation proceeds to step S25. Then 
quiet section detector 1 3 regards this section as a quiet section at 
step S25, and outputs the information thereof to scene change 
detector 1 5. 

On the contrary, if the result of the decision at step S24 
signifies that the average value is not smaller than the threshold 
value, the operation proceeds to step S26. At step S26, quiet 
section detector 1 3 does not regard this as a quiet section and then 
outputs the information thereof to scene change detector 1 5. 

The operation then returns to step S3 in FIG. 3. At step S3, 
scene change detector 1 5 detects a scene change in the two 
successive frames inputted thereto, and outputs the result of such 
detection to commercial candidate section detector 16. The details 
of this scene change detection will now be described with reference 
to a flowchart of FIG. 9. 

At step S31 , scene change detector 1 5 makes a decision as to 
whether the information inputted from quiet section detector 1 3 
indicates a quiet section or not. And if the result of this decision is 
affirmative (signifying that the input information indicates a quiet 
section), the operation proceeds to step S32. 

At step S32, scene change detector 1 5 calculates the inverse 
correlation value E of the two successive frame images inputted 
thereto. More concretely, the inverse correlation value E is obtained 
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according to the following equation by summing, as shown in FIG. 
10, the absolute values of the differences between the pixel values 
of the mutually corresponding pixels of the image (delayed image) 
inputted via delay path 14 and the image (through image) inputted 
directly: 

E = £ |D U - SJ 

where D,j and S t] denote, respectively, the pixel values at coordinates 
(i, j) of the delayed image and those of the through image. The 
inverse correlation value becomes greater with a decreased 
interframe correlation, or smaller with an increased interframe 
correlation. 

For calculating the inverse correlation value E, there may also 
be adopted some other method that uses, for example, histograms of 
the respective pixel values of the delayed image and the through 
image, or a method that divides the delayed image and the through 
image into a predetermined number of blocks and calculates the 
inverse correlation value per block on the basis of the difference 
between the pixel values. 

At step S33, scene change detector 1 5 makes a decision as to 
whether the inverse correlation value obtained at step S32 is greater 
or not than a predetermined threshold value, and if the result of this 
decision signifies that the inverse correlation value is greater than the 
predetermined threshold value [i.e., the interframe correlation degree 
is low), the operation proceeds to step S34. 

Subsequently at step S34, scene change detector 1 5 
concludes that a scene change is existent between the two 
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successive input frames, and then supplies the information thereof to 
commercial candidate section detector 1 6. 

On the contrary, if the result of the decision at step S33 
signifies that the inverse correlation value is not greater than the 
predetermined threshold value (/'.e., the interframe correlation degree 
is high), the operation proceeds to step S35. 

At step S35, scene change detector 15 concludes that there is 
no scene change between the two successive input frames, and then 
supplies the information thereof to the commercial candidate 
detector 1 6. 

In case the result of the decision at step S31 signifies that the 
information is not indicative of a quiet section, the information is 
supplied to commercial candidate section detector 1 6, and then the 
operation returns to step S4 in FIG. 3. 

At step S4, commercial candidate section detector 1 6 decides 
the commercial candidate section in accordance with the 
binary-coded audio multiplex mode signal of the preceding one 
minute of frames stored in the internal memory, and also with the 
information obtained from scene change detector 15. 

More specifically, as shown in FIG. 1 1, the audio multiplex 
mode signal (AudioMultiH) is recorded in the memory incorporated 
in commercial candidate section detector 16, where 1 denotes a 
stereo mode, and 0 denotes a monaural mode or a bilingual mode. 
There is also recorded the information (Scene_Change[]) inputted 
from scene change detector 1 5, where 1 denotes a frame with a 
scene change, and 0 denotes a frame without a scene change. 

Referring to the internal memory, commercial candidate 
section detector 1 6 partitions into sections (in this example, scene 
change sections 0 to 10) per frame (scene change point) where the 
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signal indicative of a scene change is 1 , as shown in FIG. 1 2A, and 
divides the number of the frames constituting each scene change 
section by 30 thereby calculating the time of the relevant section. 
Further, as shown in FIG. 1 2B, commercial candidate section 
detector 1 6 regards as a stereo section the consecutive frames 
where the audio multiplex mode signal is 1 . Moreover, as shown in 
FIG. 12C, commercial candidate section detector 16 regards as a 
commercial candidate section the stereo section where the time of 
the individual scene change section (or the total time of mutually 
adjacent scene change sections) is an integral multiple of 1 5 
seconds. Then, commercial candidate section detector 16 outputs a 
control signal 1 to switch 6 in the commercial candidate section, or 
outputs a control signal 0 to switch 6 in any section other than the 
commercial candidate section. 

Switch 6 is turned off in response to a control signal 1 or is 
turned on in response to a control signal 0. Switch 6 also receives, 
from modulation circuit 5, the modulated video and audio signals 
which are delayed for a period of one minute in delay circuit 4 to be 
thereby synchronized with the control signal obtained from 
commercial candidate section detector 16. In this way, only the 
video and audio signals of the program are supplied to the circuit 
stages after switch 6, while the video and audio signals of any 
commercial candidate section are not supplied thereto. 
Consequently, out of the entire television broadcast, the program is 
recorded on magnetic tape 8 without the commercial candidate 
sections. 

Hereinafter, another embodiment of commercial candidate 
section detector 16 will be described. The operation of this 
embodiment is performed under additional conditions for detection of 
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a commercial candidate section including a general tendency of 
commercials to include a plurality of scene changes. 

In this exemplary operation, as shown in FIG. 13, the quiet 
section information (quietN), outputted from quiet section detector 
13 is added to the information shown in FIG. 1 1 and then is stored 
in the internal memory of commercial candidate section detector 1 6. 
Here, 0 and 1 denote, respectively, a sound portion and a quiet 
section. In this case, the required capacity of the internal memory is 
expressed as: 

60 (seconds) X 30 (frames) X 3 (data) X 1 (bit). 

Referring to the internal memory, commercial candidate 
section detector 16 extracts the quiet sections as shown in FIG. 
14A, then extracts the scene change points as shown in FIG. 14B, 
subsequently partitions the scene change sections (in the case of 
FIG. 14C, scene change sections 0 to 10) at each scene change 
point in the quiet sections (known as "quiet scene change sections"), 
and divides, by 30, the number of the frames constituting each quiet 
scene change section, thereby calculating the time of the quiet scene 
change section. 

Further, commercial candidate section detector 16 groups the 
quiet scene change sections in such a manner that, as shown in FIG. 
14D, the time of the individual quiet scene change section or the 
total time of mutually adjacent quiet scene change sections becomes 
an integral multiple of 1 5 seconds, then extracts the sections where 
the audio multiplex mode signal is 1 as shown in FIG. 14E, and 
regards, as a commercial candidate section, any grouped stereo 
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section of an integral multiple of 15 seconds (in this example, 
sections a to c and sections d and e of FIG. 14F). 

Moreover, commercial candidate section detector 16 compares 
the number of scene changes in each of the commercial candidate 
sections (in this example, a, c, d and e) at both ends of mutually 
adjacent commercial candidate sections, with the predetermined 
threshold value [e.g., 1) as shown in FIG. 14G, and regards, as a 
commercial section, each of the commercial candidate sections (in 
this example, a and c) where the number of scene changes is greater 
than the threshold value. The commercial candidate section b 
interposed between such commercial candidate sections a and c is 
also regarded as a commercial section. 

Commercial candidate section detector 1 6 outputs a control 
signal 1 to switch 6 in the commercial candidate section, or outputs 
a control signal 0 to switch 6 in any section other than the 
commercial candidate section. 

Next, an explanation will be given of a further embodiment of 
commercial candidate section detector 16. When some absolute 
characteristic of the commercial has been altered (e.g., when the 
time of the commercial has been altered from an integral multiple of 
15 seconds to an integral multiple of 14 seconds), this operation is 
performed to alter the reference value used for decision of each 
commercial candidate section in accordance with such alteration of 
the characteristic. 

In this exemplary operation, commercial candidate section 
detector 16 partitions, with reference to the internal memory (FIG. 
1 1), the scene change sections (in this example, scene change 
sections 0 to 10 as shown in FIG. 1 5A) at frames where the signal 
indicative of a scene change is 1 , and then divides, by 30, the 

SONY-Q9138 



PATENT 

-23- 

number of the frames constituting each scene change section, 
thereby calculating the time of the relevant section. Commercial 
candidate section detector 1 6 regards consecutive frames where the 
audio multiplex mode signal is 1 as a stereo section, as shown in 
FIG. 15B. 

Thereafter, commercial candidate section detector 1 6 
compares the time of the stereo section with the time of the other 
non-stereo section adjacent to the relevant stereo section, and 
regards the stereo section (e.g., scene change sections 1 to 4 and 
scene change sections 8 and 9) as a stereo section in case the time 
of the stereo section is sufficiently shorter. Note that in alternative 
embodiments, the commercial candidate section device 16 could use 
other criteria to detect commercial candidate section, for example, 
quiet scene change sections, the presence of a black or blue frame, 
etc. 

Subsequently, since the total time of the commercial 
candidate sections (scene change sections 1 to 4) amounts to 56 
seconds, commercial candidate section detector 1 6 concludes that 
the commercial time consists of units of 7 seconds, 14 seconds or 
28 seconds. Further, as a scene change is performed at an interval 
of 14 or 28 seconds, commercial candidate section detector 16 
finally concludes that the commercial time is an integral multiple of 
1 4 seconds. 

In case the above result (signifying that the commercial time is 
an integral multiple of 14 seconds) has been obtained in succession 
more than a predetermined number of times, commercial candidate 
section detector 1 6 concludes that the duration of commercials has 
been altered to an integral multiple of 14 seconds, and thereafter 
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uses an integral multiple of 14 seconds as a reference value for 
detection of a commercial section. 

The foregoing operation may be so modified that when some 
absolute characteristic of the commercial has been altered {e.g., 
upon above-described alteration of the commercial time or abolition 
of inserting a black frame or blue frame in Europe and America), the 
corresponding new commercial section detecting reference value is 
supplied from an external device to commercial candidate section 
detector 16. In this case, commercial candidate section detector 16 
may be equipped with a rewritable recording medium such as a flash 
memory so that the commercial section detecting reference value 
can be stored therein. 

Next, a second embodiment of commercial detection circuit 3 
will be described with reference to FIG. 16. This structural example 
further includes commercial block detector 21 added to the 
aforementioned structural example of FIG. 2. Commercial block 
detector 21 detects a commercial block, which is composed of a 
plurality of commercials interposed between program portions, by 
using the number of frames of the individual commercial candidate 
section detected in commercial candidate section detector 1 6, and 
then outputs a control signal to switch 6 on the basis of the 
detection result. 

According to this second embodiment, a commercial block can 
be detected by utilizing the following commercial characteristics. 
That is, when a plurality of commercials are broadcast in succession, 
a commercial block (composed of plural successive commercials) has 
an error of 3 frames or so relative to a standard number of frames, 
although each of the commercials has an error of 5 frames or so 
relative to the standard number of frames. For example, when four 
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commercials of 15 seconds each are broadcast in succession, the 
number of frames of the individual commercials amounts to 450 ±5 
(1 5 X 30 ±5), but the number of frames of the commercial block 
becomes 1 800 ± 3 instead of 1 800 ±20 {= 15X4X30 ±5X4). 

Now the operation will be described below with reference to 
FIGS. 17 and 18. One skilled in the art will appreciate that use of 
the audio multiplex mode is an optional part of the process of 
detecting commercial candidate sections or commercial candidate 
blocks. Commercial block detector 21 reads out the frame number 
of each commercial candidate section a through e (sections 1 +2, 3, 
4, 8 and 9 of FIG. 1 7A) detected by commercial candidate section 
detector 1 6 and adds the frame number to the frame number of a 
block of adjacent commercial candidate sections (a "commercial 
candidate block") to judge whether the total number of frames is 
within a permitted range of the error (±3). Here, commercial 
candidate sections a through c form commercial candidate block A 
and commercial candidate sections d and e form commercial 
candidate block B. Then, commercial block detector 21 makes a 
decision as to whether the total number thus summed up is within 
the above-described allowable error range (±3) or not. If the result 
of this decision is affirmative, signifying that the total number of 
frames thus summed up is within the allowable error range, 
commercial block detector 21 regards the commercial candidate 
block as a commercial block. If the result of the above decision is 
negative, signifying that the total number of the frames is not within 
the allowable error range, commercial block detector 21 does not 
regard the commercial candidate block as a commercial block. 

In this case, the total number of frames of commercial 
candidate block A {commercial candidate sections a, b and c) 
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amounts to 1803 (= 453 + 446 + 904) as shown in FIG. 17, and 
the error (3) thereof to the standard number of frames (60 seconds X 
30 frames = 1800) is within the allowable range, so that 
commercial candidate block A (quiet scene change sections 1 to 4) is 
regarded as a commercial block. In this instance, the time of 
sections 1 and 2 individually is not an integral multiple of 1 5 
seconds, but the total time of these adjacent sections is 1 5 seconds, 
so they are regarded as a commercial candidate section. 

The total number of frames of commercial candidate block B 
(commercial candidate sections d and e) amounts to 910 (455 + 
455), and the error (10) thereof to the standard number of frames 
(30 seconds X 30 frames = 900) is beyond the allowable range, so 
that commercial candidate block B is not regarded as a commercial 
block. 

When commercial candidate sections shown in FIG. 18B are 
inputted from commercial candidate section detector 1 6, commercial 
block detector 21 regards commercial candidate sections a, b and c 
as a commercial candidate block A as in the aforementioned case of 
FIG. 17, and also regards commercial candidate sections d through g 
as a commercial candidate block B. Because commercial candidate 
block A has 1803 frames, which is within the 3-frame tolerance, 
commercial candidate block A is regarded as a commercial block. 
Similarly, because commercial candidate block B has 1801 frames, 
which is within the 3-frame tolerance, commercial candidate block B 
is regarded as a commercial block. 

Further, commercial block detector 21 reads, from commercial 
candidate section detector 1 6, the number of frames of the sections 
(quiet scene change sections 5 and 6) which are interposed between 
commercial blocks A and B and are not commercial candidate 
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sections. If the number of frames (in this example, 1 50) is less than 
a predetermined threshold value {e.g., 300 frames), commercial 
block detector 21 judges that these sections are not the program and 
are similar to a commercial from the perspective of the viewer, and 
then includes such sections with the preceding and following 
commercial blocks A and B. More specifically, commercial block 
detector 21 regards the quiet scene change sections 1 to 10 as one 
commercial block, as shown in FIG. 18D. 

Commercial block detector 21 outputs a control signal 1 to 
switch 6 in the commercial block and outputs a control signal 0 to 
switch 6 in any section other than the commercial block. 

Next, a third embodiment of commercial detection circuit 3 
will be described with reference to FIG. 19. This structural example 
further comprises commercial characteristic quantity detector 31 
added to the aforementioned first structural example of FIG. 2. 
Commercial characteristic quantity detector 31 receives the two 
successive frame images (video signal), the digitized audio signal, the 
information {e.g., as shown in FIG. 1 1) stored in the internal memory 
of commercial candidate section detector 1 6, and information 
regarding the commercial candidate sections detected by commercial 
candidate section detector 16. Commercial characteristic quantity 
detector 31 makes a decision as to whether the information thus 
supplied has various commercial characteristics or not and then 
detects commercial sections in accordance with the result of this 
decision. Further, commercial characteristic quantity detector 31 
outputs a control signal to switch 6 in conformity with the detection 
result. 

Now the operation of commercial characteristic quantity 
detector 31 will be described below with reference to a flowchart of 
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FIG. 20. This processing routine of characteristic quantity detection 
is executed with respect to each of the commercial candidate 
sections detected by commercial candidate section detector 1 6. 
Although commercial characteristic quantity detector 31 is described 
below as having detection, adding and judging functions, these 
functions could be performed by separate elements. 

In the embodiment described below, commercial characteristic 
quantity detector 31 assigns the same value to each commercial 
characteristic. However, these values could be varied to indicate 
that some commercial characteristics are more likely than others to 
be associated with a commercial. For example, the telop detection 
of step S46 and the character detection of step S47 could be 
assigned a higher value than other commercial characteristics. 
Moreover, any of the characteristics used to detect or verify 
commercial candidate sections could also be used by commercial 
characteristic quantity detector 31 , e.g., the number frames of a 
commercial candidate section, the total number of frames of a 
commercial candidate group, the presence of quiet scene change 
sections or the state of the audio multiplex mode. 

At step S41, commercial characteristic quantity detector 31 
initializes a commercial characteristic value to zero. At step S42, 
commercial characteristic quantity detector 31 counts the scene 
changes in the commercial candidate sections inputted from 
commercial candidate section detector 1 6 and decides whether the 
number of scene changes is more than a predetermined threshold 
value (e.g., 5 changes per 15 seconds). If the result of this decision 
is affirmative, signifying that the number of scene changes is more 
than the predetermined threshold value, 1 is added to the 
commercial characteristic value. If the result of the above decision is 
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negative, signifying that the number of the counted scene changes is 
less than the predetermined threshold value, nothing is added to the 
commercial characteristic value. This routine is based on the 
observation that in general, there are frequent scene changes in a 
commercial. 

At step S43, commercial characteristic quantity detector 31 
detects the periodicity of the audio signal in the commercial 
candidate section. This routine for detecting the periodicity of the 
audio signal is based on the observation that in general, repeated 
phrases of background music (for example, "jingles") are used in 
commercials. In the periodicity detection step, the rhythm of 
background music may also be detected. 

This routine for detection of audio signal periodicity will be 
described below with reference to the flowchart of FIG. 21 . At step 
S61, as shown in FIG. 22, commercial characteristic quantity 
detector 31 detects, as a peak, any point where the level of the 
audio signal inputted from A/D converter 1 2 is higher than a 
predetermined threshold value (FIG. 22B). FIG. 22A shows the audio 
signal in an analog form. 

At step S62, commercial characteristic quantity detector 31 
makes a decision as to whether the periodicity of the peaks detected 
at step S61 is longer than a predetermined period, which is generally 
on the order of several seconds. Periodicity may be determined by 
means of a Fast Fourier Transform ("FFT"), for example, or by simply 
measuring the intervals between the peaks. If the result of the 
above decision signifies that the periodicity of the detected peaks is 
longer than the predetermined period, the operation proceeds to step 
S63. 
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At step S63, commercial characteristic quantity detector 31 
adds 1 to the commercial characteristic value. 

If the result of the decision at step S62 signifies that the 
periodicity of the detected peaks is not longer than the 
predetermined period, nothing is added to the commercial 
characteristic value, so that step S63 is skipped. 

The operation then returns to step S44 in FIG. 20. At step 
S44, commercial characteristic quantity detector 31 detects the 
continuity of the audio signal and the video signal in the commercial 
candidate sections. This routine for detecting the signal continuity 
will now be described with reference to a flowchart of FIG. 23. 

At step S71, commercial characteristic quantity detector 31 
makes a decision as to whether the periodicity of the audio signal 
peaks is continuous for a time longer than 95% of the duration of 
the commercial candidate section. Measuring the continuous 
duration of the peak periodicity is performed on the basis of the 
aforementioned information obtained at step S43. If the result of the 
decision at step S71 signifies that the periodicity of the audio signal 
peaks is continuous for a time longer than 95% of the duration of 
the commercial candidate section, the operation proceeds to step 
S72. 

Then at step S72, commercial characteristic quantity detector 
31 adds 1 to the commercial characteristic value. 

If the result of the decision at step S71 is negative, signifying 
that the periodicity of the audio signal peaks is not continuous for a 
time longer than 95% of the duration of the commercial candidate 
section, nothing is added to the commercial characteristic value, so 
that step S72 is skipped. 
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At step S73, commercial characteristic quantity detector 31 
calculates the differences between the values of mutually 
corresponding pixels in the two successive images, and detects any 
pixels where the difference is less than a predetermined threshold 
value, i.e., the pixels without motion between the two images. At 
step S74, commercial characteristic quantity detector 31 produces 
histograms of the pixel values detected at step S73, and then 
detects the pixel value indicative of the maximum as a representative 
color of the background. The processes at steps S73 and S74 are 
executed repeatedly at a predetermined interval in the commercial 
candidate section. 

At step S75, commercial characteristic quantity detector 31 
refers to the representative background color or colors detected at 
step S74, and makes a decision as to whether the same pixel value 
is being detected continuously as the representative background 
color. If the result of this decision is affirmative, signifying that the 
same pixel value is being detected continuously as the representative 
background color, the operation proceeds to step S76. 

Subsequently at step S76, commercial characteristic quantity 
detector 31 adds 1 to the commercial characteristic value. 

In case the result of the decision at step S75 signifies that the 
same pixel value is not detected continuously as the representative 
background color, nothing is added to the commercial characteristic 
value, so that step S76 is skipped. 

Thereafter, the operation returns to step S45 in FIG. 20. At 
step S45, commercial characteristic quantity detector 31 detects 
image repetition. This routine for detection of image repetition is 
based on the observation that in a commercial, the same images are 
generally repeated. For example, a 1 5-second commercial for 
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ketchup may be composed of a scene of green forest (3 seconds), a 
scene of blue sky (2 seconds), a scene of green forest (2 seconds), a 
scene of red ketchup (3 seconds), a scene of green forest (2 
seconds) and a scene of red ketchup (3 seconds). 

This routine for detection of the image repetition will now be 
described with reference to the flowchart of FIG. 24. At step S81, 
commercial characteristic quantity detector 31 divides the 
commercial candidate section at scene change points. At step S82, 
commercial characteristic quantity detector 31 produces 
1 6-gradation histograms of the pixel values of each scene divided at 
step S81, and then detects the pixel value, which indicates the 
maximum, as a representative color of the relevant scene. 

At step S83, commercial characteristic quantity detector 31 
makes a decision as to whether the representative color of the scene 
is repeated in the commercial candidate section (whether the same 
representative color is detected in the other scene). If the result of 
this decision is affirmative, signifying that the representative color of 
the scene is repeated, the operation proceeds to step S84. 

At step S84, commercial characteristic quantity detector 31 
adds 1 to the commercial characteristic value. 

If the result of the decision at step S83 is negative, signifying 
that the representative color of the scene is not repeated, nothing is 
added to the commercial characteristic value, so that step S84 is 
skipped. One skilled in the art will appreciate that the histograms 
described above could have more or less than 16 gradations. In 
addition, alternative embodiments of the process of detecting image 
repetition could determine different representative colors for different 
portions of the image. 
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Thereafter, the operation returns to step S46 in FIG. 20. At 
step S46, commercial characteristic quantity detector 31 detects a 
"telop" (which could be a logo, a graphic, a mark, a slogan, or the 
like), an example of which is shown in FIG. 26A. This routine for 
detection of a telop is based on the observation that a telop is often 
displayed at the end of a commercial. However, in alternative 
embodiments, this routine could be modified to search for a telop at 
any part of a commercial candidate section. 

Now the routine for detection of a telop will be described 
below with reference to the flowchart of FIG. 25. At step S91, 
commercial characteristic quantity detector 31 detects, in each 
frame image of a predetermined time (e.g., 5 seconds) at the end of 
the commercial candidate section, adjacent pixels which exceed a 
predetermined number and have an equal pixel value as shown in 
FIG. 26B. 

At step S92, commercial characteristic quantity detector 31 
searches for and regionalizes the pixels having the same pixel value 
as that of the pixels detected at step S91 , as shown in FIG. 26C. 

At step S93, commercial characteristic quantity detector 31 
makes a decision as to whether the regions obtained at step S92 are 
continuous in time (whether the same regions are existent in 
successive frames). If the result of this decision is affirmative, 
signifying that the regions are continuous in time, the operation 
proceeds to step S94. 

At step S94, commercial characteristic quantity detector 31 
detects the centroids of all regions on the image, then calculates the 
average value of the distances between the centroids and the 
individual points in the regions. Commercial characteristic quantity 
detector 31 compares this average value with a predetermined 
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threshold value and makes a decision as to whether the regions are 
dense. If the result of this decision is affirmative, signifying that the 
regions are dense, the operation proceeds to step S95. 

At step S95, commercial characteristic quantity detector 31 
adds 1 to the commercial characteristic value. 

If the result of the decision at step S93 is negative, signifying 
that the regions are not continuous in time, nothing is added to the 
commercial characteristic value and step S95 is skipped. 

The operation returns to step S47 in FIG. 20. At step S47, 
commercial characteristic quantity detector 31 makes a decision, by 
the same method as that used in the foregoing routine for detection 
of a telop, as to whether characters on the image (which may or may 
not be part of a telop) are existent for more than a predetermined 
time in the entire section from the start of the commercial candidate 
section to the end thereof. If the result of this decision is 
affirmative, signifying that the characters on the image are existent 
for more than the predetermined time, 1 is added to the commercial 
characteristic value. If the result of the above decision is negative, 
signifying that the characters on the image are not existent for more 
than the predetermined time, nothing is added to the commercial 
characteristic value. This processing routine is based on a general 
characteristic that characters are often displayed in a commercial. 

At step S48, commercial characteristic quantity detector 31 
detects a quiet section rate in any other portion than the start and 
end points of the commercial candidate section. This processing 
routine for detection of a quietness rate is based on a general 
characteristic that quiet sections are rare in a commercial. This 
routine for detection of a quietness rate will be described below with 
reference to the flowchart of FIG. 27. 
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At step S101, commercial characteristic quantity detector 31 
reads out the information {e.g., the information shown in FIG. 1 1) 
stored in the internal memory of commercial candidate section 
detector 1 6, and detects the number of quiet section frames other 
5 than the start and end points of the commercial candidate section, as 

shown in FIG. 28. Commercial characteristic quantity detector 31 
divides the number of the detected quiet section frames by the total 
number of frames constituting the commercial candidate section, 
thereby calculating the quietness rate. 

10 At step S102, commercial characteristic quantity detector 31 

makes a decision as to whether the quietness rate calculated at step 
S101 is lower than a predetermined threshold value or not. If the 
result of this decision is affirmative, signifying that the quietness rate 
is lower than the predetermined threshold value, the operation 

15 proceeds to step S103. 

At step S103, commercial characteristic quantity detector 31 
adds 1 to the commercial characteristic value. 

If the result of the decision at step S102 is negative, 
signifying that the quietness rate is not lower than the predetermined 

20 threshold value, nothing is added to the commercial characteristic 

value, so that step S103 is skipped. 

Then the operation returns to step S49 in FIG. 20. At step 
S49, commercial characteristic quantity detector 31 makes a 
decision as to whether the commercial characteristic value is greater 

25 than a predetermined threshold value. If the result of this decision is 

affirmative, signifying that the commercial characteristic value is 
greater than the predetermined threshold value, the operation 
proceeds to step S50. At step S50, commercial characteristic 
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quantity detector 31 regards the commercial candidate section as a 
commercial section. 

In case the result of the decision at step S49 signifies that the 
commercial characteristic value is not greater than the predetermined 
threshold value, the operation proceeds to step S51 . Then at step 
S51, commercial characteristic quantity detector 31 concludes that 
the commercial candidate section is not a commercial section. 

In conformity with the result of the above conclusion, 
commercial characteristic quantity detector 31 outputs a control 
signal 1 to switch 6 in the commercial section and outputs a control 
signal 0 to switch 6 in any other section than the commercial 
section. 

As described above, according to the video recorder (FIG. 1) 
representing an exemplary embodiment of the present invention, only 
the program in a television broadcast is recorded on magnetic tape 8, 
while the commercial included in the broadcast is not recorded. 
Consequently, when magnetic tape 8 is reproduced, only the 
program is displayed. 

It is observed that some users want to record a commercial as 
well although skipping the same in a reproduction mode by fast- 
forwarding or the like. A second embodiment of a video recorder 
designed to address this need by adopting the present invention will 
now be described below with reference to FIG. 29. In this second 
embodiment, switch 6 used in the aforementioned structure of FIG. 
1 is deleted, and the result of the commercial detection performed in 
commercial detection circuit 3 is supplied to write circuit 7. 

In the recording unit of the second embodiment, write circuit 7 
records, on magnetic tape 8, all of the video and audio signals (of 
both the programs and the commercials of a television broadcast) 
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inputted from modulation circuit 5, and also records information 
relative to the commercial (e.g., the temporal positions of the 
commercial) at predetermined positions of magnetic tape 8, on the 
basis of the information obtained from commercial detection circuit 
3. 

In the reproducing unit of this embodiment, read circuit 9 
responds to a commercial elimination command inputted from the 
user for reproducing only the program, then demodulates only the 
program while eliminating the commercial (by fast-forwarding or the 
like) on the basis of the commercial information recorded at the 
predetermined positions of magnetic tape 8, and supplies the same 
to a monitor (not shown). 

It is to be understood that the presently-claimed invention is 
applicable not merely to a video recorder alone, but also to a 
television receiver, a tuner and so forth. Alternatively, the presently- 
claimed invention could be embodied as an add-on to be used with 
(but could be sold separately from) an existing video recorder, 
television receiver or tuner. 

A computer program for executing the above processing 
routines may be provided to users via an adequate provision medium 
which could consist of an information recording medium such as 
magnetic disk or CD-ROM, or via a network provision medium such 
as the Internet, a digital satellite or the like. 

Thus, according to the present invention, commercial 
candidate sections are detected and then a commercial block is 
formed out of the detected plural commercial candidate sections, 
hence achieving exact detection of the commercial included in a 
television broadcast. 
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Although only certain embodiments have been described in 
detail, those having ordinary skill in the art will certainly understand 
that many modifications are possible without departing from the 
teachings thereof. All such modifications are intended to be 
encompassed within the following claims. 
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1 . An apparatus for processing a television signal, wherein 
the television signal comprises frames of programs and 
commercials, the apparatus comprising: 

receiving means for receiving a television signal; 
commercial candidate block detecting means for 
detecting a commercial candidate block comprising one or 
more commercial candidate sections in the television signal; 

measuring means for measuring a length of the 
commercial candidate block; 

judgement means for making a first judgement of 
whether the length of the commercial candidate block is 
within a predetermined range of an integral multiple of a 
standard length; and 

determining means for determining whether the 
commercial candidate block is a commercial block according to 
the first judgement. 

2. The apparatus according to claim 1, wherein the 
standard length is 1 5 seconds. 

3. The apparatus according to claim 1, wherein the 
standard length is 450 frames. 
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4. The apparatus according to claim 1, further comprising: 
commercial candidate section detecting means for 

detecting commercial candidate sections in the television 
signal; 

extracting means for extracting commercial candidate 
sections having a substantially predetermined length; and 
wherein 

the commercial candidate block detecting means 
detects commercial candidate blocks based on the extracted 
commercial candidate sections. 

5. The apparatus according to claim 1, wherein: 
the measuring means measures the length of an 

intermediate section between commercial candidates; 

the judgement means makes a second judgement of 
whether or not the length of the intermediate section is within 
an intermediate section length range; and 

the determining means determines whether the 
intermediate section is part of a commercial block according to 
the second judgement. 

6. The apparatus according to claim 2, wherein the 
predetermined range is 0.1 second. 

7. The apparatus according to claim 3, wherein the 
predetermined range is 3 frames. 

8. The apparatus according to claim 4, wherein the 
commercial candidate section detecting means detects 
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commercial candidate sections based on whether the 
commercial candidate sections are within a predetermined 
range of an integral multiple of a standard length. 

5 9. The apparatus according to claim 4, wherein: 

the television signal comprises an audio multiplex mode; 
the commercial candidate section detecting means 
comprises audio multiplex mode detecting means for detecting 
an audio multiplex mode in the television signal; and 
10 the extracting means extracts a commercial candidate 

section according to the audio multiplex mode detected by the 
audio multiplex mode detecting means. 



10. The apparatus according to claim 4, wherein: 
15 the television signal comprises scene changes; 

the commercial candidate section detecting means 
comprises scene change detection means for detecting scene 
changes in the television signal; and 

the extracting means extracts a commercial candidate 
2 0 section according to the scene changes detected by the scene 

change detection means. 

1 1 . The apparatus according to claim 5, wherein the 
intermediate section length range is 10 seconds. 

25 

12. The apparatus according to claim 5, wherein the 
intermediate section length range is 300 frames. 
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1 3. The apparatus according to claim 8, wherein the 
standard length is 1 5 seconds. 

14. The apparatus according to claim 8, wherein the 
5 standard length is 450 frames. 

1 5. The apparatus according to claim 8, wherein the 
predetermined range is 1/6 of a second. 

10 16. The apparatus according to claim 8, wherein the 

predetermined range is 5 frames. 

1 7. An apparatus for processing a television signal, 
comprising: 

15 signal receiving means for receiving a television signal; 

commercial candidate section detecting means for 
detecting a commercial candidate section in the television 
signal; 

a first measuring means for measuring a length of the 
2 0 commercial candidate section; 

a first judgement means for making a first judgement of 
whether the length of the commercial candidate section is 
within a first predetermined range of an integral multiple of a 
standard length; 

25 a second measuring means for measuring the length of 

an intermediate section between commercial candidate 
sections; 
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a second judgement means for making a second 
judgement of whether the length of the intermediate section is 
within a second predetermined range; and 

commercial block determining means for determining a 
commercial block of one or more commercial candidate 
sections according to the first judgement and the second 
judgement. 

18. An apparatus for processing a television signal, 
comprising: 

signal receiving means for receiving a television signal; 

commercial extracting means for extracting a 
commercial based on a reference criterion indicative of a 
commercial characteristic; 

alteration detecting means for detecting an alteration of 
the commercial characteristic; and 

changing means for changing the reference criterion 
according to the alteration of the commercial characteristic 
detected by the alteration detecting means. 

1 9. The apparatus according to claim 1 8, wherein the 
alteration detecting means detects the length of a commercial. 

20. The apparatus according to claim 1 8, further comprising 
reference criterion storing means for storing the reference 
criterion. 

21 . The apparatus according to claim 20, wherein the 
reference criterion storing means comprises a memory. 

SONY-Q9138 



PATENT 



22. The apparatus according to claim 21, further comprising 
criterion receiving means for receiving a new reference 
criterion which is input from an external device, wherein the 

5 memory receives the new reference criterion from the criterion 

receiving means. 

23. An apparatus for processing a television signal, wherein 
the television signal comprises frames of programs and 

10 commercials, the apparatus comprising: 

a receiver for receiving a television signal; 
a first detector for detecting a commercial candidate 
block comprising one or more commercial candidate sections 
in the television signal; 
15 a measuring circuit for measuring a length of the 

commercial candidate block; 

a comparitor for making a comparison of whether the 
length of the commercial candidate block is within a 
predetermined range of an integral multiple of a standard 
2 0 length; and 

a second detector for determining whether the 
commercial candidate block is a commercial block according to 
the comparison. 

25 24. The apparatus according to claim 23, wherein the 

standard length is 1 5 seconds. 



25. The apparatus according to claim 23, wherein the 
standard length is 450 frames. 
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26. The apparatus according to claim 23, further 
comprising: 

a third detector for detecting commercial candidate 
sections in the television signal; 
5 an extracting circuit for extracting commercial candidate 

sections having a substantially predetermined length; and 
wherein 

the first detector detects commercial candidate blocks based 
on the extracted commercial candidate sections. 

10 

27. The apparatus according to claim 23, wherein: 
the measuring circuit measures the length of an 

intermediate section between commercial candidates; 

the comparitor makes a second judgement of whether 
15 or not the length of the intermediate section is within an 

intermediate section length range; and 

the second detector determines whether the 
intermediate section is part of a commercial block according to 
the second judgement. 

20 

28. The apparatus according to claim 24, wherein the 
predetermined range is 0.1 second. 

29. The apparatus according to claim 25, wherein the 
25 predetermined range is 3 frames. 

30. The apparatus according to claim 26, wherein the third 
detector detects commercial candidate sections based on 
whether the commercial candidate sections are within a 
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predetermined range of an integral multiple of a standard 
length. 

31 . The apparatus according to claim 26, wherein: 

5 the television signal comprises an audio multiplex mode; 

the third detector comprises an audio multiplex mode 
detector for detecting an audio multiplex mode in the 
television signal; and 

the extracting circuit extracts a commercial candidate 
10 section according to the audio multiplex mode detected by the 

audio multiplex mode detector. 

32. The apparatus according to claim 26, wherein: 
the television signal comprises scene changes; 

15 the third detector comprises a scene change detector 

for detecting scene changes in the television signal; and 

the extracting circuit extracts a commercial candidate 
section according to the scene changes detected by the scene 
change detector. 

20 

33. The apparatus according to claim 27, wherein the 
intermediate section length range is ten seconds. 

34. The apparatus according to claim 27, wherein the 
25 intermediate section length range is 300 frames. 

35. The apparatus according to claim 30, wherein the 
standard length is 1 5 seconds. 
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36. The apparatus according to claim 30, wherein the 
standard length is 450 frames. 

37. The apparatus according to claim 30, wherein the 
predetermined range is 1/6 of a second. 

38. The apparatus according to claim 30, wherein the 
predetermined range is 5 frames. 

39. An apparatus for processing a television signal, 
comprising: 

a receiver for receiving a television signal; 

a detector for detecting a commercial candidate section 
in the television signal; 

a timer for measuring a length of the commercial 
candidate section and for measuring the length of an 
intermediate section between commercial candidate sections; 

a first comparitor for making a first comparison of 
whether the length of the commercial candidate section is 
within a first predetermined range of an integral multiple of a 
standard length; 

a second comparitor for making a second comparison of 
whether the length of the intermediate section is within a 
second predetermined range; and 

a commercial block detector for detecting a commercial 
block of one or more commercial candidate sections according 
to the first comparison and the second comparison. 
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40. An apparatus for processing a television signal, 
comprising: 

a receiver for receiving a television signal; 

a commercial extracting circuit for extracting a 
5 commercial based on a reference criterion indicative of a 

commercial characteristic; 

a detector for detecting an alteration of the commercial 
characteristic; and 

an updating circuit for updating the reference criterion 
10 according to the alteration of the commercial characteristic 

detected by the detector. 



41 . The apparatus according to claim 40, wherein the 
detector detects the length of a commercial. 

15 

42. The apparatus according to claim 40, further comprising 
a memory for storing the reference criterion. 

43. The apparatus according to claim 42, further comprising 
2 0 an input device for receiving a new reference criterion which is 

transmitted from an external device, wherein the memory 
receives the new reference criterion from the input device. 



44. A method of processing information in an information 
2 5 processing apparatus for detecting commercials included in a 

television broadcast, the method comprising: 
receiving a television signal; 

detecting a commercial candidate block comprising one 
or more commercial candidate sections in the television signal; 
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measuring a length of the commercial candidate block; 

making a judgement of whether the length of the 
commercial candidate block is within a predetermined range of 
an integral multiple of a standard length; and 
5 determining whether the commercial candidate block is 

a commercial block according to the judgement. 



45. The method according to claim 44, wherein the 
standard length is 1 5 seconds. 

46. The method according to claim 44, wherein the 
standard length is 450 frames. 



47. The method according to claim 44, further comprising: 
15 a commercial candidate section detecting step of 

detecting commercial candidate sections in the television 
signal; 

an extracting step of extracting commercial candidate 
sections having a substantially predetermined length; and 
2 0 wherein 

the commercial candidate block detecting step 
comprises detecting commercial candidate blocks based on the 
extracted commercial candidate sections. 



25 48. The method according to claim 44, wherein: 

the measuring step comprises measuring the length of 
an intermediate section between commercial candidates; 
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the judgement step comprises making a second 
judgement of whether or not the length of the intermediate 
section is within an intermediate section length range; and 

the determining step comprises determining whether the 
5 intermediate section is part of a commercial block according to 

the second judgement. 



49. The method according to claim 45, wherein the 
predetermined range is 0.1 second. 

50. The method according to claim 46, wherein the 
predetermined range is 3 frames. 



51 . The method according to claim 47, wherein the 
15 commercial candidate section detecting step comprises 

detecting commercial candidate sections based on whether the 
commercial candidate sections are within a predetermined 
range of an integral multiple of a standard length. 



20 52. The method according to claim 47, wherein: 

the television signal comprises an audio multiplex mode; 
the commercial candidate section detecting step 
comprises an audio multiplex mode detecting step of detecting 
an audio multiplex mode in the television signal; and 
25 the extracting step comprises extracting a commercial 

candidate section according to the audio multiplex mode 
detected in the audio multiplex mode detecting step. 
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53. The method according to claim 47, wherein: 

the television signal comprises scene changes; 
the commercial candidate section detecting step 

comprises a scene change detection step of detecting scene 
5 changes in the television signal; and 

the extracting step comprises extracting a commercial 

candidate section according to the scene changes detected in 

the scene change detection step. 

10 54. The method according to claim 48, wherein the 

intermediate section length range is 10 seconds. 

55. The method according to claim 48, wherein the 
intermediate section length range is 300 frames. 

15 

56. The method according to claim 51, wherein the 
standard length is 1 5 seconds. 

57. The method according to claim 51, wherein the 
2 0 standard length is 450 frames. 

58. The method according to claim 51, wherein the 
predetermined range is 1/6 of a second. 

25 59. The method according to claim 51 , wherein the 

predetermined range is 5 frames. 
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60. A method for processing a television signal, comprising: 
a signal receiving step of receiving a television signal; 
a commercial candidate section detecting step of 

detecting a commercial candidate section in the television 

signal; 

a first measuring step of measuring a length of the 
commercial candidate section; 

a first judgement step of making a first judgement of 
whether the length of the commercial candidate section is 
within a first predetermined range of an integral multiple of a 
standard length; 

a second measuring step of measuring the length of an 
intermediate section between commercial candidate sections; 

a second judgement step of making a second judgement 
of whether the length of the intermediate section is within a 
second predetermined range; and 

a commercial block determining step of determining a 
commercial block of one or more commercial candidate 
sections according to the first judgement and the second 
judgement. 
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61 . A method for processing a television signal, comprising: 

a signal receiving step of receiving a television signal; 

a commercial extracting step of extracting a commercial 
based on a reference criterion indicative of a commercial 
5 characteristic; 

an alteration detecting step of detecting an alteration of 
the commercial characteristic; and 

a changing step of changing the reference criterion 
according to the alteration of the commercial characteristic 
10 detected in the alteration detecting step. 



62. The method according to claim 61 , wherein the 
alteration detecting step comprises detecting the length of a 
commercial. 

63. The method according to claim 61, further comprising a 
reference criterion storing step of storing the reference 
criterion. 



2 0 64. The method according to claim 63, wherein the 

reference criterion storing step comprises storing the reference 
criterion in a memory. 

65. The method according to claim 64, further comprising: 
25 a criterion receiving step of receiving a new reference 

criterion which is input from an external device; and 

a transmission step of transmitting the new reference 
criterion to the memory. 
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66. A provision medium for providing a program which is 
readable by a computer to control an apparatus to execute a 
detection routine for detecting commercials included in a 
television broadcast, the detection routine comprising the 
steps of: 

receiving a television signal; 

detecting a commercial candidate block comprising one 
or more commercial candidate sections in the television signal; 

measuring a length of the commercial candidate block; 

making a judgement of whether the length of the 
commercial candidate block is within a predetermined range of 
an integral multiple of a standard length; and 

determining whether the commercial candidate block is 
a commercial block according to the judgement. 

67. The provision medium according to claim 66, wherein 
the standard length is 1 5 seconds. 

68. The provision medium according to claim 66, wherein 
the standard length is 450 frames. 

69. The provision medium according to claim 66, wherein 
the detection routine further comprises: 

a commercial candidate section detecting step of 
detecting commercial candidate sections in the television 
signal; 

an extracting step of extracting commercial candidate 
sections having a substantially predetermined length; and 
wherein 
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the commercial candidate block detecting step 
comprises detecting commercial candidate blocks based on the 
extracted commercial candidate sections. 



5 70. The provision medium according to claim 66, wherein: 

the measuring step comprises measuring the length of 
an intermediate section between commercial candidates; 

the judgement step comprises making a second 
judgement of whether or not the length of the intermediate 
10 section is within an intermediate section length range; and 

the determining step comprises determining whether the 
intermediate section is part of a commercial block according to 
the second judgement. 

15 71. The provision medium according to claim 67, wherein 

the predetermined range is 0.1 second. 

72. The provision medium according to claim 68, wherein 
the predetermined range is 3 frames. 

20 

73. The provision medium according to claim 69, wherein 
the commercial candidate section detecting step comprises 
detecting commercial candidate sections based on whether the 
commercial candidate sections are within a predetermined 

25 range of an integral multiple of a standard length. 

74. The provision medium according to claim 69, wherein: 
the television signal comprises an audio multiplex mode; 
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the commercial candidate section detecting step 
comprises an audio multiplex mode detecting step of detecting 
an audio multiplex mode in the television signal; and 

the extracting step comprises extracting a commercial 
5 candidate section according to the audio multiplex mode 

detected in the audio multiplex mode detecting step. 

75. The provision medium according to claim 69, wherein: 
the television signal comprises scene changes; 

10 the commercial candidate section detecting step 

comprises a scene change detection step of detecting scene 
changes in the television signal; and 

the extracting step comprises extracting a commercial 
candidate section according to the scene changes detected in 

15 the scene change detection step. 

76. The provision medium according to claim 70, wherein 
the intermediate section length range is 10 seconds. 

20 77. The provision medium according to claim 70, wherein 

the intermediate section length range is 300 frames. 

78. The provision medium according to claim 73, wherein 
the standard length is 15 seconds. 

25 

79. The provision medium according to claim 73, wherein 
the standard length is 450 frames. 
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80. The provision medium according to claim 73, wherein 
the predetermined range is 1/6 of a second. 

81. The provision medium according to claim 73, wherein 
the predetermined range is 5 frames. 

82. A provision medium for providing a program which is 
readable by a computer to control an apparatus to execute a 
detection routine for detecting commercials included in a 
television broadcast, the detection routine comprising: 

a signal receiving step of receiving a television signal; 

a commercial candidate detecting step of detecting a 
commercial candidate section in the television signal; 

a first measuring step of measuring a length of the 
commercial candidate section; 

a first judgement step of making a first judgement of 
whether the length of the commercial candidate section is 
within a first predetermined range of an integral multiple of a 
standard length; 

a second measuring step of measuring the length of an 
intermediate section between commercial candidate sections; 

a second judgement step of making a second judgement 
of whether the length of the intermediate section is within a 
second predetermined range; and 

a commercial block determining step of determining a 
commercial block of one or more commercial candidate 
sections according to the first judgement and the second 
judgement. 
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83. A provision medium for providing a program which is 
readable by a computer to control an apparatus to execute a 
detection routine for detecting commercials included in a 
television broadcast, the detection routine comprising: 

a signal receiving step of receiving a television signal; 

a commercial extracting step of extracting a commercial 
based on a reference criterion indicative of a commercial 
characteristic; 

an alteration detecting step of detecting an alteration of 
the commercial characteristic; and 

a changing step of changing the reference criterion 
according to the alteration of the commercial characteristic 
detected in the alteration detecting step. 

84. The provision medium according to claim 83, wherein 
the alteration detecting step comprises detecting the length of 
a commercial. 

85. The provision medium according to claim 83, wherein 
the detection routine further comprises a reference criterion 
storing step of storing the reference criterion. 

86. The provision medium according to claim 85, wherein 
the reference criterion storing step comprises storing the 
reference criterion in a memory. 
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87. The provision medium according to claim 86, wherein 
the detection routine further comprises: 

a criterion receiving step of receiving a new reference 
criterion which is input from an external device; and 

a transmission step of transmitting the new reference 
criterion to the memory. 
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ABSTRACT OF THE DISCLOSURE 
An information processing apparatus capable of accurately 
detecting commercials included in a television broadcast. A 
commercial candidate section detector detects a commercial 
candidate section based on the characteristics of transitions between 
a program and a commercial and based on the characteristics of 
commercials. Transitional criteria include quiet sections, scene 
change points and changes in the audio multiplex mode. A 
commercial block detector detects a commercial block, which is 
composed of a plurality of commercial sections and is interposed 
between program portions, in conformity with the number of frames 
of the individual commercial candidate sections detected by the 
commercial candidate section detector, and then outputs to a switch 
a control signal based on the result of such commercial block 
detection. 
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Revision of PTO/SB/106 (8-96) 



BY EXPRESS MAIL NO. EL254066439US 



Declaration and Power of Attorney For Patent Application 


Japanese Language Declaration 




As a below named inventor, I hereby declare that: 




My residence, post office address and citizenship are as 
stated next to my name. 




I believe I am the original, first and sole inventor (if only one 
named is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention 
entitled. 

INFORMATION PROCESSING APPARATUS, 
INFORMATION PROCESSING METHOD, AND 
DISTRIBUTION MEDIA 






S a «^ KITES Hi Lfc. 


the specification of which is attached hereto unless the 
following box is checked: 

j [ was filed on as United States Application 

Number or PCT International Application Number 
and was amended on (if applicable). 


C ALU. »l^*«Bfc*tf±ieffjE*<DWW**MitU 


1 hereby state that 1 have reviewed and understand the 
contents of the above identified specification, including the 
claims, as amended by any amendment referred to above. 




1 acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of 
Federal Regulations, Section 1.56. 


SLI±. *3£*»3 5»1 1 9^(a)-(d)giXa3 6 5* 
(b)3tfc**TlEfl>. *HWA©Sto*te<i:t>— *H*» 
JfcUTV»*1M*»>!)*» 3 6 5 (a) < BRUMS. X 
tt*EB"e»»lf ffl«tt> L < »S38f|ffSEOfflBK:-3V*-C©a-H 
«S« £ ^ - it £ST o c c 6 1<- . SSmzIHtXi'>4, 


I hereby claim foreign priority under Title 35, United States 
Code, Section 119(a)-(d) or 365(b) of any foreign 
application(s) for patent or inventor's certificate, or 365(a) of 
any PCT International application which designated at least 
one country other than the United States, listed below and 
have also identified below by checking the box, any foreign 
appfication for patent or inventor's certificate, or PCT 
International application having a filing date before that of the 
application on which priority is claimed. 


Prior Foreign Application (s) 

Pin-^-^Q974 Japan 
(Number) (Country) 


Priority Not Claimed 

30 November 1998 

(Day/Month/Year Filed) 

unwrap) 
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Japanese Langu< 

(Number) (Country) 
(#-^) (S£) 


ige Declaration 

(Day/Month/Year Filed) 


mt. *3 5ffl*H2fc&l 1 9*(e)*c3^-CTIE«}|fe 

(Application No.) (Filing Date) 


I hereby claim the benefit under Title 35, United States Code, 
Section 119(e) of any United States provisional application(s) 

(Application No.) (Filing Date) 

(KM* (UflB) 


TIE03ifeasS»*3 581 2 OjfcKJtWTTJEflD* 
€**tt3 6 5 *(c)fc3£-f<«|*JS:CwtC±3IL*i-. * 

application No.) (Filing Date) 

mx&*) (wet b } 

(Application No.) (Filing Date) 


I hereby claim the benefit under Title 35, United States Code, 
Section 120 of any United States application(s), or 365(c) of 
any PCT International application designating the United 
States, listed below and, insofar as the subject matter of 
each of the claims of this application is not disclosed in the 
prior United States or PCT International application in the 
manner provided by the first paragraph of Title 35, United 
States Code, Section 112, I acknowledge the duty to disclose 
information which is material to patentability as defined in 
Title 37, Code of Federal Regulations, Section 1.56 which 
became available between the filing date of the prior 
application and the national or PCT International filing date of 
application. 


(Status: Patented, Pending, Abandoned) 


(Status: Patented, Pending, Abandoned) 


fclrt'<a$;8S£T*i5Tfc3£fiu,T^.5£t. s&Kfc 
«Kft*nfcJt»o«W2kt)f**T#J:n»of7att*ll26J^» 
188X10 0 l*fc£-f t. fi&SfcttKHR. 1»L<tt* 

iff ttx.ii. muLit. xttKKir?r4ivfc*MiF 


I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on 
information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful 
false statements and the like so made are punishable by fine 
or imprisonment, or both, under Section 1001 of Title 18 of 
the United States Code and that such willful false statements 
may be jeopardize the validity of the application or any patent 
issued thereon. 



Page 2 of 4 



Revision of PTO/SB/106 (8-96) 



Japanese Language Declaration 




POWER OF ATTORNEY: As a named inventor, I hereby 
appoint the following attorney(s) and/or agent(s) to prosecute 
this application and transact all business in the Patent and 
Trademark office connected therewith (for name and 
registration number) 


Karl A. Limbach 18,689 
George C. Limbach 19,305 
John K. Uilkema 20,282 
Neil A. Smith 25,441 
Veronica C. Devitt 29,375 
Ronald L. Yin 27,607 
Gerald T. Sekimura 30,103 
Michael A. Stallman 29,444 
Philip A. Girard 28,848 
Michael J. Pollock 29,098 
Stephen M. Everett 30,050 
Alfred A. Equitz 30,922 


Mark A Dalla Valle 34,147 
Charles P Sammut 28,901 
Mark C Pickering 36,239 
Patricia Coleman James 37,155 
Kathleen A Frost 37,326 
Alan S Hodes 38,185 
Alan A Limbach 39,749 
Douglas C. Limbach 35,249 
Seong-Kun Oh* 

Cameron A King 41,897 
Kyla L Harnel 41,816 
* Recognition under 37 CFR 10 9(b) 


Mayumi Maeda 40,075 
KentJ. Tobin 39,496 
Michael R. Ward 38,651 
Roger S. Sampson 44,314 
Tina Chen 44,606 
Charles L. Hamilton 42,624 
Andrew V Smith 43,132 
Katja Dunbar Peralta 40,768 
Eric N. Hoover 37,355 
J. Thomas McCarthy 22,420 
Joel G Ackerman 24,307 




Send Correspondence to: 

Charles P. Sammut, Esq. 
Limbach & Limbach L.L.P. 
2001 Ferry Building 
San Francisco, CA 94111-4262 




Direct Telephone Calls to: (name and telephone 
number) 

Charles P. Sammut 
(415) 433-4150 




Full name of sole or first inventor: 
TARO SUITO 




Inventor's signature Date 




Residence 

Kanagawa, Japan 


mn 


Citizenship 
Japan 




Post Office Address 

c/o SONY CORPORATION 
7-35, Kitashinagawa 6-chome 
Shinagawa-ku, Tokyo, 141-0001 JAPAN 
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Full name of second joint inventor, if any 
MAS ASH 1 OHTA 






Second inventor's signature 


Date 




Residence 

Tokyo, Japan 


tun 


Citizenship 
Japan 




Post Office Address 

c/o SONY CORPORATION 
7-35, Kitashinagawa 6-chome 
Shinagawa-ku, Tokyo, 141-0001 JAPAN 






Full name of third joint inventor, if any 






KATSUNARI MIYATA 






Third inventor's signature 


Date 


mm 


Residence 

Tokyo, Japan 


'mm 


Citizenship 
Japan 




Post Office Address 

c/o SONY CORPORATION 
7-35, Kitashinagawa 6-chome 
Shinagawa-ku, Tokyo, 141-0001 JAPAN 
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